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Abstract — With the development of information fusion, a new 
theory based on Dezert-Smarandache Theory (DSmT) was 
widely applied to lots of aspects. Owing to the difficulty of 
handling conflict evidence combination when tracking multiple 
moving objects under occlusion conditions, a DSmT method with 
anti-occluding objects tracking in complex background is 
proposed based on occlusion judgment prediction, and the 
corresponding computing examples of generating hyper-power 
sets and tracking under different occluding conditions are 
analyzed and discussed in this paper. Calculation results show 
that the method is proven to be correct and effective in tracking 
occluded objects. When analyzing multi-objects tracking under 
very complex environment, it will lay a firm foundation for 
further solving information fusion of conflict evidences. 

Keywords-I nfonn ation fusion; DSmT; conflict evidence; objects 
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I. Introduction 

Moving object tracking is one of core technology in 
computer vision, and it is an important element of surveillance, 
guidance, obstacle avoidance system 1 '"’ 1 . Moving object 
tracking includes advanced knowledge and research results of 
image processing, pattern recognition, artificial intelligence, 
automatic control and computer applications, etc. With a 
knowledge of a priori distributions and conditional 
probabilities, the probabilistic methods, and especially the 
Bayesian inference, offer the most complete, scalable and 
theoretically justifiable approach for data fusion. However, in 
real complex scenes such complete knowledge is difficult to 
obtain due to high occlusion, background clutter, illumination 
and camera calibration problems. An alternative approach is 
proposed for data fusion; namely the Dempster-Shafer (DST) 
theory [4] . DST theory does not require the knowledge of prior 
probabilities. The uncertainty and imprecision of a body of 
knowledge are represented via the notion of confidence values 
that are committed to a single or a union of hypotheses. The 
orthogonal sum rule of DST theory allows the integration of 
information from different sources into a single and overall 
representation 1 ^' 61 . Unfortunately, Bayesian inference and 
Dempster-Shafer theories lack to provide an interesting manner 
of modeling conflicts and paradoxical inteiriretation arising 
between the difference information sources . The Bayesian 
inference assumes that all sources provide bodies of evidences 



using the same objective and universal interpretation of the 
phenomena under consideration; therefore, it cannot handle 
conflicts. In most practical fusion applications based on DST 
theory, ad-hoc or heuristic techniques must always be added to 
the fusion process to manage or reduce the possibility of high 
degree conflict between the sources. Otherwise, the fusion 
result leads to false conclusions or cannot provide a reliable 
result at all. To overcome these limitations, a recent theory of 
plausible and paradoxical reasoning has been developed. The 
Dezert-Smarandache theory (DSmT) can be considered as a 
generalization of the DST theory in [8]. In this paper, a 
sequential particles filter approach for multiple targets tracking 
using multiple cues will be proposed, and the different cues are 
combined based on the DSmT. If the targets are partially or 
completely occluded, the conflicts and paradoxes that arise 
between the measured cues are assessed and used in the 
tracking process. The proposed scheme is simple and provides 
an effective tracking in cluttered scenes. By the simulation 
computing and discussion, result shows that the tracking 
method proposed is excellent and effective for objects tracking 
in some complex environment. 

II. Occluding Problem and Dsmt 

When tracking object is part or whole occluded, object 
tracking system must have good robust to anti-occluding, and 
the system can capture object over again and maintain tracking. 
Therefore, the system is asked for the below ability. Firstly, 
moving object can be stable tracked under the order condition. 
Secondly, object can be judged under occlusion condition. 
Thirdly, object can be effective identified and tracked newly 
after object is occluded. 

It is very different to be divided up object from some 
background when moving object is in the complex 
environment by PF. Considering DSmT is more desirable in 
the case of solving conflicting evidence, it is more efficient in 
combining conflict evidence especially when the evidences 
conflict highly, and the occlusion problem can be solved 
effectively when moving object is tracked. So, the DSmT will 
be used to the object tracking. 

While the DST considers 0 as a set of exclusive elements, 
the DSmT relaxes this condition and allows for overlapping 
and intersecting hypotheses. This allows for quantifying the 
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conflict that might arise between the different sources 
throughout the assignment of non-null confidence values to 
the intersection of distinct hypotheses. 

Let 0 = { 6 * 1 , 9k) be a set of k elements which can 

potentially overlap. The hyper-power set D is defined as the 
set of all composite hypotheses obtained from 0 with U and 
D operators such that. 

1 ).<p,9 h 9 2 ,...,9 k ^D & . 

2) . If A, B e d\ then (A Ufi)e D & and (AHB) <E d\ 

© 

3) . No other elements belong to D , except those defined in 1) 

and 2). As in the DST, the DSmT defines a map m(.): 

e 

D -^[0,1]. This map defines the confidence level that each 

0 

sensor associates with the element of D . This map supports 



paradoxical information, and „ 

2_ i m(A) = l 

AeD 0 

The belief and plausibility functions are defined in the 
same way as for the DST. The DSmT rule of combination of 
conflicting and on uncertain sources is given by. 

m ( A ) = 1 ( 1 ) 

n « 



m(A)= Yj U m MjV 

A l ,A 2 ,...Aj-eD 0 j = 1 
A l C)A 2 n...A f =A 



( 2 ) 



III. Object tracking based on Dsmt 



Let us consider X,= (x h x 2 ,... r >c l ) as the state vector (location, 
size, etc.) describing the object and Z,= (z u z 2 ,...,z,) as the 
vector of measurements (color, texture, etc.) up to time t. The 
tracking is based on the estimation of the posterior state 
distribution p{x,\Z ,) at each time step. The estimation is 
performed using a two step Bayesian recursion. The first step 
is prediction. 

The second step is filtering. 

P(x t \ z t)°°\ P(-,\ X ,)P( X ,\ Z ,-i) ' 



This recursion requires the specification of the state 
evolution p{x t \x t . i) and a measurement model linking the state 
and the current measurement p(z,\X t ). The basic idea behind 
the particle filter is very simple, and starting with a weighted 
set of samples. 
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L J= 1 J 

Which describe object candidates and distributed according 
to p(x,-i\z,_i), new samples are obtained by propagating each 
sample according to the object’s state model, p(x,\x t .{). In the 
filtering step, each sample is weighted given the observation 
and k samples are drawn with replacement according to 
Ji t =p(z t \x t ). The value is given by the below expression. 



£[S,]= X K, U) s, U) ■ (6) 

i= i 

Let’s assume that the number of object t and the number 
of cues c are known. Up to time t- 1, each object is associated 



with a track. At time t, an image frame is extracted from the 
video sequence and a number of measurements are obtained 
for each object candidate. Thus, the objective is to combine 
these measurements in order to determine the best track for 
each candidate. It is important to notice that a object candidate, 
in this paper, refers to a particle sample. The hyper-power set 

iff j r defines the set of the hypotheses for which the 

l y j j = i 

different cues can provide confidence values. 

These hypotheses can correspond to: 

Stepl: individual tracks 9j. 

Step2: union of tracks 9,. U ... U 9 S , which symbolizes 
ignorance. 

Step3: intersection of tracks 9,P\...f\9 s , which symbolizes 
conflict. 

Step4: track combination by U and IT operators. The 
confidence level is expressed in terms of mass function that is 
committed to each hypothesis and which satisfies the 
condition. 

Given this framework, expresses the confidence with 
which cue / associates particle « to hypothesis A at time t. 
According to DSmT combinational rule, a single map function 
can be derived as follows. 

m) n) (A) = mff (•) © mft(-) © ••• © m ™ (•) • ( 7 ) 

Where rrl"\A) is the overall confidence level with, which all 

cues associate particle n to hypothesis A at time t. 

Since the object candidates must be associated to 
individual tracks, the information contained in compound 
hypotheses is transferred into single hypotheses through the 
notions of the belief or plausibility functions. 

S e /, (n) (^)= Xm}'>(A)- (8) 

0 ,CA 
AeD 0 

Pls™(0 J )= ’Zm^(A)- (9) 

0,C A 
AeD 0 

Where Bel‘ t n> (0 j ) (resp. Pls\ n) (9 j ) ) quantifies the confidence 

with which particle n is associated to 9j at time t using the 
notion of belief (resp. plausibility). The confidence levels are 
not used to determine whether a given a candidate is the best 
estimate or not of the object, they are rather used to quantify 
the weight of the candidate as a sample of the state posterior 
distribution p(z,\X t ). 

IV. Computing Analysis and Discussion 

Example 1 In this section, generating hyper-power sets D 0 
will be analyzed firstly, because it is important to estimate the 
memory size for storing the elements of D° for \0\ =n. In most 
fusion applications only a small subset of elements of D 0 have 
a non-null basic belief mass, because all the commitments are 
just usually impossible to assess precisely when the dimension 
of the problem increases. Thus, it is not necessary to generate 
and keep in memory all elements of D 0 , but only those which 
have a positive belief mass. However, it is very important how 
to manage efficiently all elements of the hyper-power sets D 0 . 
So, the part computing program of generating hyper-power 




sets D e is given as follows. 



n=input (’0<n<7’); 
u_n=[l]; 

for nn=2:n 

u_n=[u_n nn ( u_n*10+nn*ones (l,size ( u_n*10,2 ) ))]; 
end 

D nl =[0;1]; 

for nn=l :n , D n =[]; 

for i =l:size (D_nl,l ),Li=D_nl (i,:); 
for j=i:size (D_nl,l) 

Lj=D nl (j,:) ; Li_inter_Lj=and (Li.Lj); 

Li_union_Lj=or(Li,Lj ); 

if( ( Li_inter_Lj==Li )&(Li_union_Lj==Lj )) 

D n=[D n;Li Lj]; 
end 
end 
end 

D nl=D n ; 
end 

DD=D n;DD(:,l)=[];DD(size (DD,1),:)=[]; D n=DD; 
disp ([ jTheta|=n=’ ,num2str(n)]) 
disp ([’|D"Theta|= ’,num2str( size (Dn ,1))]) 
disp ([’with u_n=[’,num2str(u_n ),’]”and’]) 



According to the above program given, an example is 
given to discuss the generating of hyper-power sets in this 
paper. We hypotheses n=2, generation of D 0 is equivalent to 
generate Un and matrix Dn, which can be easily obtained by the 
procedure given. At last, the corresponding transpose matrix 
D 3 of D 3 is gotten by matrix computing as follows. 



D' 



0000000000000001 1 11 
000000000001 1100011 
0000001111111111111 
0000010000100100101 
0001110011101111111 
0010110101111101111 
0 111111111111111111 



Example 2 Based on the DSmT method, a tracking under 
occluding conditions is simulated with crossing objects and 
closely spaced objects in the process of tracking. Two objects 
are selected in order to analyze conveniently. Each object is 
tracked using 20 particles only. An increased number of 
particles will result in a smoother tracking, while increasing 
the processing time. The tracking sequence is divided into 
three phases. Phase 1 is the pre -occlusion sequence, phase 2 
corresponds to the occlusion sequence, and phase 3 is the post- 
occlusion sequence. Tracking in phase 2 is challenging due to 
the closeness of the object, which perturbs the measured cues 
and might lead to a false identification. The simulation 
scenario consists of two objects, and a stationary sensor at the 
origin with r=5second, measurement standard deviations 0.4° 
and 70m for azimuth and range, respectively. 

Firstly, two crossing moving object will be analyzed. For 
two crossing moving object, the tracking method based on 
DSmT-PF is applied to produce the attribute probability term 
in generalized assignment matrix, and the corresponding 
computing results of tracks’ purity in case of generalized data 



association is gotten as shown in table 1. Where missing is 
used for the case when in the track’s gate there is no 
observation, and wrong is used for the case when the track is 
associated with the false alarm. It is very obvious that the 
tracks’ purity is increases from the result in table I . 



Table I . Two Crossing objects Values of Data Association Based 
on Dsmt 



Object 

tracking 


tracking 1 


tracking 2 


missing 


wrong 


Object 1 


0.774 


0.120 


0.014 


0.007 


Object 2 


0.135 


0.768 


0.014 


0.003 



Secondly, two closely spaced objects will be analyzed. For 
two closely spaced objects, and one can easily see that the two 
closely spaced moving in parallel objects lose the proper 
directions and the tracks switch. At last, the tracking method 
based on DSmT is applied to discuss the data association 
problem, and the corresponding results based on DSmT are 
given in table II . Results show the proper data associations in 
condition of two closely spaced objects. 



TABLE II . Two Closely Spaced Objects Values of Data Association 
Based on Dsmt 



Object 

tracking 


tracking 1 


tracking 2 


missing 


wrong 


Object 1 


0.665 


0.235 


0.002 


0.0004 


Object 2 


0.203 


0.450 


0.001 


0.0000 



After discussing the above two tracking processes of data 
association, the confidence levels for all particles during the 
tracking will be simulated analysis. The DSmT model is 
effective handled for the conflicting information provided 
based on DSmT method. At last, the variation of the average 
value of the confidence levels for all particles during the 
tracking are gotten by simulating, and the corresponding 
results are shown in figure 1 . 




Figure 1 . Confidence levels variation for all particles 



According to the figure 1, the confidence level for the 
occluded object m m% (0\) is high during phases 1 and 3, but it 
decreases in phase 2 (see figure la). However, in phase 2 the 
object is occluded and this reduces the confidence value 
provided. During the same phase, the confidence remains high, 
which explains the increase in the conflict as 

shown in figure lb. The belief function Bel mg {9\) is given in 
figure lc, and this curve shows the high confidence with 







which the object is located despite the occlusion. This is 
mainly due to the introduction of the conflict information 
through the DSmT model. Figures Id shows that the effect of 
the occlusion on the occluding object is small in comparison 
with its effect on the occluded object. The existence of such an 
effect can be justified by the presence of object 1 in the 
immediate neighborhood of object 2, which rapidly modifies 
the corresponding measurement for some particles. 

Conclusion 

The introduced method is given to analyze moving objects 
tracking under occluding conditions, and the below 
conclusions can be obtained by the computing simulation and 
discussion. 

1) . The DSmT is more desirable in the case of solving 
some occluding problems, and it is more efficient in 
combining conflict evidence especially when the evidences 
conflict highly. 

2) . In view of the occluding in detecting moving objects in 
complex background, a new object tracking method of DSmT 
is proposed to track occluded objects and interference objects, 
and the result show that method is effective and practicable. 

3). Calculation of observation likelihood is a difficult 
problem under the circumstance of occlusion based on DSmT, 
and its difficulty lies in the use unreliable information to obtain 



the reliable track effect in very complex environment. 
Therefore, how to more improve tracking stability and 

robustness is very important task, too. 
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